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RATIONAL  MODELING  BY  PENCIL-OF-FUNCTIONS  METHOD 


V.  K.  Jain  *  T.  K.  Sarkar  **  D.  D.  Weiner  # 

Senior  Member,  IEEE  Senior  Member,  IEEE  Member,  IEEE 

ABSTRACT 

Pole-zero  modeling  of  signals,  such  as  an  electromagnetic- 
scstterer  response,  is  considered  in  this  paper.  It  is  shown  by  use  of 
pendl-of-functlons  theorem  that  (a)  the  true  parameters  can  be  recovered 
In  the  ideal  case  (where  the  signal  is  the  impulse  response  of  a  rational 
function  H(z)),  and  (b)  the  parameters  are  optimal  in  the  functional  depen¬ 
dence  sense  when  the  observed  data  are  corrupted  by  additive  noise  or  by 
systematic  error.  Although  the  computations  are  more  Involved  than  In  all¬ 
pole  modeling,  they  are  considerably  less  than  those  required  in  iterative 
schemes  of  pole-zero  modeling.  The  advantages  of  the  method  are  demon¬ 
strated  by  a  simulation  example  and  through  application  to  the  electro¬ 
magnetic  response  of  a  scatterer. 

The  paper  also  includes  very  recent  and  promising  results  on  a  new 
approach  to  noise  correction.  In  contradistinction  with  spectral  subtraction 
techniques,  where  only  amplitude  information  is  emphasized  (and  phase  is 
Ignored),  we  propose  a  method  that  (a)  estimates  the  noise  spectral  density 
for  the  data  frame,  and  then  (b)  performs  the  subtraction  of  the  noise  corre¬ 
lation  matrix  from  the  Gram  matrix,  of  the  signal. 

I.  INTRODUCTION 

Signal  representation  and  approximation  [l]-[4]  is  basic  to  (a)  time-domain 
extraction  of  singularities  of  a  scatterer's  field  pattern  [S],[6],[16]  and  to  (b) 

recursive  digital-filter  synthesis  [7],  [12].  It  is  also  useful  in  (c)  bandwidth 
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compression  of  signals  [2 1 »  *nd  (d)  time-domain  measurement  and  testing  of 
networks /channels.  This  paper  discusses  a  unified  approach  to  representing 
or  approximating  a  given  empirical  signal  x(t)  by  sum  of  exponentials,  i.e., 
for  finding  the  right  hand  side  of 


n  s<t 

x(t)  s  y(t)  -  I  d.  e  —*■  Y(s) 


(la) 


1-1 
n  d . 


Y(s) 


1-1  *  “  8i 

or,  equivalently,  the  right  hand  side  of  the  sampled  version 

n 


(lb) 


x(k)  «  y(k)  -  Z  R.(z.)k  Y(z) 
1-1  1  1 


(2a) 


R. 


Y(z)  -  I 


1-1  (l-ai*“1) 


l  +  a1*"1+... 

BM 

A(z) 


(2b) 


The  poles  s^  (or  z^  in  z-domain)  are  either  real.  Or  they  occur  in  complex 
conjugate  pairs. 

When  equality  holds  in  (2a),  the  sampled  signal  x(k)  is  said  to  be 
rational  of  order  n,  and  thus  rationally  representable.  Additionally,  if 
Re  s^  <  0  (or,  |zjJ<  1)  it  is  said  to  be  stable-rational  of  order  n. 

In  the  method  described  here,  the  given  signal  is  processed  in  reverse- 
time  by  a  cascade  of  first  order  digital  filters  to  yield  a  family  of  infor¬ 
mation  signals.  The  Gram  matrix  F  of  these  information  signals  is  shown  to 
contain  the  essential  information  on  the  denominator  parameters  of  Y(z). 


2 


y,(0 
-  y(k) 


y,(k) 


•  •  • 


yn(k)  yHCk) 

-*■  v(z)  - 


u(z)  ■  I/O  *  qz) 

Fig.  1.  Reverse-time  processing  by 
first-order  filters 


Specifically,  it  is  shown  that  A(z)  is  determined  as 

_  n+1  . 

A(z)-  (qz)  [  I  ^.(qc-l)**1"1]/^ 
i-1  X  ■ 

where  are  the  diagonal  cofactors  of  the  matrix  F.  The  numerator  para¬ 
meters  are  then  determined  using  a  least-squares  fit,  i.e. ,  b  •  -P^c, 
where  P  and  £  are  defined  in  the  paper. 

The  entire  procedure  is  thus  noniterative  and  computationally  efficient. 
Iterative  methods,  such  as  the  modified  Newton  method  (2],  require  as  many 
as  a  hundred  Iterations,  each  involving  a  matrix  inversion.  Our  computations 
are  roughly  equivalent  to  two  matrix  inversions.  It  is  a  generalization  of 
the  method  developed  in  [8]  to  reverse-time  processing  by  first  order  filters. 
This  formulation  results  in  a  lower  order  matrix  (n+1  dimensional)  than  did 
the  formulation  in  [8]  (2n+l  dimensional).  Examples  presented  demonstrate  (1) 
noiseworthlness  in  the  representation  problem  when  data  are  corrupted  by 
noise  and  (ii)  the  effectiveness  of  the  method  in  the  approximation  problem. 
Comparison  of  the  method  with  the  maximum  entropy  method  (or  all-pole  linear 
predictor)  and  the  Prony  method  [1],  [4]  is  also  included  in  the  paper. 

II.  FIRST-ORDER  FILTER  BASED  INFORMATION  SIGNALS 
Suppose  a  suitable  K  has  been  selected  such  that  x(k)  -  0  for  k  >_  K  (so 
that  use  of  the  upper  limit  K-l  instead  of  «  on  summations  may  be  permitted). 
We  define  the  reverse-time  first-order  filtered  signals  as  (see  Fig.  1) 
x1(k)  -  x(k) 

Xj(k)  -  qx2(k+l)  +  x^OO  (3) 


x^(k)  -  qXjj(k+l)  +  *B00 
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N.  Further,  0  <  q  <  1. 


where  N  -  n+1,  and  x^OO  •  0  for  i  -  1,  2 . 

This  fatally  of  signals^,  which  we  ahall  call  information  signals, 
possesses  the  Interesting  property  stated  below. 


Lemma  1 

If  x(k)  -  y(k)  is  stable-rational  of  order  n  with  poles  then  the 
corresponding  information  signals  are  also  stable  rational  of  order  n  with 
the  poles  x^: 


Wk) "  1 


*1 


1-1  (1-q  se) 


I  <‘l> 


(4) 


Proof:  We  prove  this  by  Induction.  For  i-0  the  statement  is  trivially  true 
since  (4)  is  identical  to  (2)  for  this  case.  Assuming  it  to  be  true  for  i-1, 
let  us  proceed  to  prove  it  is  true  for  i. 

From  (3) 

yi+l<k)  -  qyi+10t+U  +  yA(k) 


which  is  readily  shown  to  be  equivalent  to 


ri+l 


(k)  -  I  qV"k  y.(v) 

V-k 


n 

-  Z 


R. 


_  _  Vrk.  .v 

ToT *  «  ‘V 


1-1  (1-q  Zg)  V-k 

(from  induction  hypothesis) 


Z  Rl  1_Y  z\  ZqV'k(*£)V“k 
1-1  (1-q  ztV  1  *  V-k 


The  result  of  equation  (3)  follows  immediately  by  observing  that 


The  nomenclature  ’information  signal'  is  not  to  be  confused  with  traditional 
information  theoretic  concepts.  It  is  used  here  because  these  signals  will 
be  shown  to  yield  the  denominator  parameters  of  Y(s). 
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I 

V»k 


V-k 


(i-q  *A) 


Before  leaving  this  section,  ve  remark  that  the  set  y^,  . yQ  Is 

linearly  Independent,  while  the  set  y, ,  . ..,  y  ,  y  ..  is  linearly  dependent. 

A  n  n+A 


III.  DETERMINATION  OF  PARAMETERS  VIA  PENCIL-OF-FUNCTIONS 
THEOREM  FOR  RATIONALLY  REPRESENTABLE  SIGNALS 

In  this  section  we  will  determine  the  signal  parameters  for  the  case 

x(k)  “  y(k),  l.e.,  where  the  signal  is  rationally  representable.  Ve  will 

call  (see  (2))  the  poles  of  the  impulse  response,  R^  the  corresponding 

residues,  and  ■  {(z^)  }  the  associated  modes.  Note  that  the  poles  occur 

in  conjugate  pairs  whenever  complex,  as  do  the  residues,  since  y  is  real. 

The  significance  of  Lenma  1  of  the  previous  section  arises  from  the 

fact  that  each  of  the  information  signals  contains  the  modes  “  {(z^)  }, 

2 

I  -  1,  ...,  n.  Further,  the  pencil-of-signals  Y  yi+^  +  3^  a^so  contains 

all  these  modes  unless  Y  equals  one  of  the  poles;  in  the  latter  case,  l.e., 

k-. 

when  Y  *  *  »  Y  y....  +  7m  does  not  contain  the  mode  £■{(*_)  }.  This  re¬ 
ar  i+1  i  mm 

suits  in  the  following  observation 
Lemma  2.  The  set 

-  1)y2  +  yl*  (qzm  ~1>y3  +  y2 .  (qZm  ~1)yN  +  yn  (5) 

is  linearly  dependent  for  m  «  1,  2,  . ..,  n  where  z  are  the  poles  of  the 

m 

right  hand  side  of  (2). 

Definition.  Define  the  N  x  N  dimensional  Gram  matrix  (recall,  N  *  n+l)[ll] 


The  terminology  pencil-of-f unctions  is  derived  from  literature  in  physics 
and  mathematics;  see,  for  example,  Gantroacher  [9j  where  A  +  XB  is  called 
a  pencil  of  matrices  A  and  B  parametrized  by  sealer  X.  See  also  Gueguen[10] 
for  recent  usage. 
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n 


F  - 


<F1»F1>  ••• 


l’'N 


L-<yN,yl>  <yN*V-l 


K-l 

^.y,*  m  1  y^kjy.oo 

x  j  k-0  1  J 


(6) 


or,  equivalently 


K-i  T 
F  -  I  ffr) £(k) 
k-0 


(7) 


where 


X  00  -  [y1(k)  y2(k)  ...  yN(k)]. 

We  can  now  apply  the  pencll-of- functions  theorem  of  reference  [8]  to 
obtain  the  central  theoretical  result  of  this  section.  A  statement  of 
pencll-of- functions  theorem  is  given  in  Appendix  A. 

Theorem  1.  The  poles  of  the  impulse  response  y(k)  must  satisfy  the  equation 


K 


Z  A)  (qz-l)**-1  -  0 
1-1  X 


(8) 


where  D.  are  the  diagonal  cofactors  of  the  Gram  matrix  F  (defined  in  (7)). 

1 

Proof:  The  theorem  follows  immediately  upon  application  of  the  pencil-of- 
functions  theorem  (reference  [8])  to  the  set  (5). 

Mote  that  the  denominator  of  transform  of  the  impulse  response  is  given 

by 

N 


A(z)  -  D~1^2(qz)"n  Z  A),  (qz-l)1*”1 
A  i-1  * 


(9) 


This  follows  from  (8)  by  dividing  through  by  zn  and  by  normalizing  the 
coefficients  so  that  the  leading  coefficient  becomes  unity. 
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The  numerator  parameters  can  be  found  by  the  method  of  least  squares, 
specifically  by  solving  the  linear  equation 

p  b  -  c  (10) 

where  b  -  [bo  bx  ...  b^]1,  c  -  [co  c±  ...  c^]1,  P  -  IPjjh 

Py  *  <UA.  “j*  (11a) 

Ci  “  <ui»  y>  .  (lib) 

Here  uA  denotes  the  Impulse  response  of  z-i/A(z).  Note  that  u^k)  - 
u(k-i)  where  u(k)  Is  the  Impulse  response  (l.e.,  inverse  z-transform) 
of  1/A(z).  All  Inner  products  are  sunned  from  k  ■  0  to  K-l. 

Remarks .  Before  leaving  this  section  we  remark  that  the  parameters 
characterizing  the  signal,  l.e.,  the  coefficients  of  the  polynomials 
A(z)  and  B(z),  are  recovered  exactly.  It  is  assumed  of  course  that  the 
signal  is  of  the  form  (1)  and  that  the  true  model  order  is  known. 

The  idea  of  reverse-.time  integration  was  proposed  by  Carr  in  p.3  and 
Jain  in  1X4  •  Here,  we  have  generalized  the  concept  of  reverse-time  pro¬ 
cessing  to  the  case  of  first-order  filter  processing.  Note  that  the  first 
order  filter  l/(l-qz),  used  above,  encompasses  integration;  Just  let  q  ■  1. 

IV.  MODELING  IN  THE  PRESENCE  OF  NOISE 

/ 

In  the  last  section  we  modeled  an  ideal  signal  from  its  samples.  The 
effect  of  additive  noise  is  now  considered.  The  samples  available  are 
x(k)  -  y(k)  +  0  w(k)  (12) 

where  w(k)  is  a  zero  mean  white  noise  process  and  o  is  an  unknown  positive  con¬ 
stant.  As  in  Section  II,  the  information  signals  are  again  generated  by 
processing  x(k)  -  x^(k)  by  the  filter  cascade  of  Pig.  1.  (see  Fig.  2). 
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a*(k) 


Fig.  2.  Noisy  signal  through  first-order  filters 


Note,  because  of  the  linearity  of  the  filters,  that 

x^k)  “  3^00  +  o  w^k)  (13) 

Then  it  can  be  seen  that  the  expected  value  of  the  Gran  matrix  G  of  the 
vector  signal  x(k)  ■  [x^k)  x2(k)  ...  x^k)]*  is3 
K-l  T  2 

Eg  -  E  E  x(k)  jr (k)  -  f  +  o  w  (14) 

k-0 

where  U  is  the  covariance  matrix  of  the  unit  noise  vector  sequence  w(k)  ■ 

T  2 

[w,  (k)  w_(k)  ...  w„(k)]  and  is  known  before  hand.  To  estimate  o  and  F 
12  « 

we  use  the  following  criterion. 


Jain's  Identification  Criterion  [J5] 

Consistent  with  the  noise  and  bias  models  the  estimated  Gram  matrix 

should  achieve  a  minimum  possible  determinant. 

Using  the  above  criterion  and  equation  (14),  the  following  estimation 

procedure  has  been  developed. 

2 

Step  1.  Estimate  O  as 


02 


G_10W 


(15) 


where  ©  denotes  matrix  inner  product  (i.e.,  zQu  ■  EE  z ^  w^j). 


Step  2.  F  -  G  -  O2  W  (16) 

A 

Step  3.  Use  F  in  estimating  A(z)  and  B(z)  via  (9)  and  (10). 

The  justification  for  formulas  (15)  and  (16)  is  given  in  Appendix  B. 


JThe  expected  value  operator  is  denoted  as  E 
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SIGNAL  UNDER  TEST 


Fig. 3(b)  A  simulated  noisy  signal  under  test 
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-i  <s=f 


A. 


V.  A  COMPUTER  SIMULATION  EXAMPLE 


Let 


y(k) 


-1  -2 
1  -  1.922  A  +  z  * 


1  -  2.68z-1  +  2.476z"2  -  0.782z"3 


,  (1  -  e^m  -  e"30*"1! _ 

<1  -  0.8452z"1)(l  -  re3ez_1)(l  -  re"30*"1) 

(6  •  0.28379;  r  -  0.96187,  6  -  0.30528) 
be  truncated  at  k  •  99.  The  signal  to  be  tested  is  formed  as 
*(k)  -  y(k)  +  a  w(k) 
where  w(k)  is  a  zero  mean,  uncorrelated  noise  sequence.  The  positive  scalar 
O  is  chosen  to  be  0.0425  so  that  the  signal- to-nolse  ratio  Is  12  dB.  The  true 
signal  y(k)  and  the  noisy  signal  x(k)  are  shown  In  Fig.  3. 

The  signal  under  test  was  modeled  by 

1.  Pencil  of  functions  method  (without  applying  noise  correction); 
reverse-time  processing  pole  q  was  taken  as  0.8. 

2 

2.  Pencil-of-functions  method  with  estimation  of  a  and  F;  the  value 
of  q  was  again  taken  to  be  0.8. 

4 

3.  All-pole  covariance  technique.  Minimum  error  criterion,  rather  than 
equal  energy  criterion  was  used  to  establish  the  gain  parameter. 

4.  Pole-zero  model  using  Prony  method.  Note  that  the  denominator  para¬ 
meters  (and,  of  course,  the  poles)  are  the  same  ss  that  for  the  all-pole 
covariance  method  [2].  The  numerator  parameters  are  then  determined  by  least- 
squares  fit. 

Fifty  simulation  runs,  each  with  a  different  sample  of  noise,  were  per¬ 
formed.  The  ’mean’  and  'standard  deviation  (S.D.)'  of  the  various  quantities 

4 

The  all-pole  autocorrelation  method  yields  very  similar  results  in  the  present 
case;  hence,  the  autocorrelation  method  is  not  Included. 
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(17) 


(18) 


of  Interest  are  shown  in  Table  1.  Of  course,  the  aodel  order  was  taken  to 
be  3  and  the  number  of  signal  samples  used  were  100. 

The  poles  for  the  above  fifty  runs  are  listed  in  Appendix  C,  Tables  C1-C3. 

A  graphical  portrayal  of  the  z-domain  poles  for  10  runs  is  given  in  Figures 
4  to  6.  The  location  of  the  true  poles  is  at  the  centers  of  the  circles 
shown  in  these  figures.  Judging  from  the  normalized  mean  square  errors  in 
Table  1,  as  well  as  from  the  scattergrams  of  the  poles,  it  appears  that  the 
penell-of-functions  method  can  perform  reliable  modeling  of  a  rational  signal 
even  when  it  is  masked  by  noise.  As  Is  widely  known,  the  Prony  method  (and 
of  course  the  covariance  method)  perform  quite  poorly  in  the  presence  of  noise. 

It  is  sometimes  claimed  that  the  Prony  method  (or  the  all-pole- covariance 
method)  performs  well  with  short  data-frame.  Ve  give  the  poles  of  ten  runs 
with  the  first  10  data  points  of  the  noisy  signal  used  in  the  above  experiments. 
These  poles  are  given  in  Fig.  7.  Again  a  wide  and  unreliable  scatter  of  the 
poles  is  produced. 

VI.  APPLICATION  TO  AN  ELECTROMAGNETIC  PULSE  (EMP) 

As  a  real  world  application  we  consider  the  use  of  pendl-of-functions 

method  to  the  transient  response  of  a  conducting  pipe  tested  at  the  ATHAMAS-I 

EMP  simulator.  The  conducting  pipe  is  10m  long  and  lm  in  diameter.  Hence, 

the  true  resonance  of  the  pipe  is  expected  to  be  in  the  neighborhood  of  14MHz. 

Also,  the  pipe  has  been  excited  in  such  a  way  that  it  is  reasonable  to  expect 

only  odd  harmonics  at  the  scattered  fields.  The  data  measured  are  the  Integral 

of  the  E-fleld:  i.e.,  the  measured  variable  is  a  voltage.  The  transient 

response  used  for  analysis  is  shown  in  Fig.  8  by  the  solid  line.  The  results 

of  analysis  by  the  pencll-of-functlons  method  are  given  in  Table  2  for  an  8th 

order  model;  the  model  response,  with  an  error  of  0.0125,  is  shown  in  Fig.  8 
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Table  1 


Comparison  of  PencM-of-Functions  Method  With 

All-pole  covariance  and  Prony  Methods 
(Results  of  fifty  noisy  runs:  SNR-12  dB) 


Mean  +  S.D. 
of 


POF 


Method 

POF  with 

noise 

correction 


All-pole 

covariance 


Prony 


a,  -2.5974  ♦  0.0216  -2.6753  +  O.OI85  -0.5200  ♦  0.0747 
a2  2. 3^38  +  0.0388  2.4698  +.  0.0331  -0.2334  +  0.1123 
a3  -0.7288  +  0.0187  -0.7803  +  0.0160  0.0161  +  0.0710 

Error  (NMSE)  0.0314  +  0.0095  0.0055  +  0.0052  0.1726  +  0.0164  0.1499+0.0098 


Note:  From  (17)  the  true  parameters  are  a^  *  -2.68,  a2  *  -2.476  and  a^  -  -0.782 

The  denominator  parameters  for  the  al 1 -pole-covariance  method  are  the 
same  as  those  of  the  Prony  method 
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Fig.  5.  Poles  obtained  In  ten  (10)  simulation  runs  by 

pendl-of-f unctions  method  with  noise  estimation. 
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by  the  dotted  line.  The  sampling  Interval  is  A  »  0.97656  ns  and  the  number 
of  samples  analyzed  is  R  *  245.  Mote  that  noise  estimation  and  correction, 
as  described  In  Section  IV,  has  been  used  in  the  analysis.* 

Table  2 

Poles  of  a  Scatterer  Response  Estimated  by 
Pencil-of-Functions  Method  (q*0.8) 

fundamental  >5.72  +j  68.63  Mrad/s  (10.96 

) 

3rd  harmonic  -30.65  +J  212.60  Mrad/s  (33.83 

curve-fit  pair  -1.95  8.72  Mrad/s  (  1.42 

curve-fit  pair  -20.17  4-j  95.58  Mrad/s  (15.55 

VII.  RECURSIVE  DIGITAL  FILTER  SYNTHESIS  EXAMPLE 
As  a  final  example  we  consider  the  use  of  pencil-of- Tunctions  technique 
to  digital  filter  synthesis.  Suppose  the  desired  Impulse  response  is  [12] 

hd°°  "  f°*25»  k“° 

\sin(0.25k)/k,  1  <  k  <  K  -  256 

It  represents  the  causal  part  of  the  inverse  DFT  of  a  low-pass  filter  with 
cutoff  at  0.25  Hz.  The  application  of  the  pencil-of-functions  technique, 
with  q  ■  0.4,  yields  the  following  filter 

0.25-0. 38841z"1+0.29346z"2-0.05783z"3-0.42025z-4 

H(z)  -  - - - -- - 13  I4 

1  -2.46160z  *+2.78530z  -1.52226z  J40.34885z 

with  a  normalized  mean-square  error  0.00473.  Note  that  the  minimum  value 

of  NMSE,  as  obtained  in  [12]  by  iterative  methods f  is  0.00346. 

*The  computer  output  listings  are  given  In  Appendix  D. 

^Seventy  iterations  were  needed  to  achieve  the  minimum  value. 
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CONDUCTING  PIPE  TEST 


Measured  data 
Model  Impulse  response 


Pencl 1 -of-f uncti ons 
With  noise  estimation 
and  correction 


I  - 1 - * - 1 - 1 - 1 - 1 - 

0  40  80  120  160  200  240 

—  k  — ► 

Fig.  8.  Comparison  of  measured  data  (of  the  response  of 
of  a  conducting  pipe)  and  model  Impulse  response 
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VIII,  CONCLUSIONS 

Pole-zero  Modeling  of  signals  has  been  considered  In  this  paper.  It 
was  shown  that  for  rational  signals  the  true  parameters  can  be  recovered 
from  the  Cram  matrix  of  the  information  signals.  The  latter  were  formed 
by  reverse-time  processing  of  the  given  signal  by  a  cascade  of  first  order 
digital  filters.  Further,  we  have  formulated  a  new  approach  to  noise  esti¬ 
mation  and  correction  by  minimizing  the  determinant  of  the  estimated  Gram 
matrix.  The  examples  demonstrate  the  practicality  of  the  approach,  not 
only  because  the  computations  are  noniterative,  but  also  because  the  poles 
of  the  signal  are  estimated  quite  accurately.  It  is  felt  that  the  method 
can  be  used  in  a  broad  range  of  applications,  for  example,  finding  the 
singularities  of  a  scatter  response,  modeling  of  speech  and  in  spectrum 
analysis. 

Extension  of  the  technique  to  modeling  of  multichannel  signals  with 
common  modes  (or  singularities)  is  possible.  This  work  is.  underway.  A 
second  area  of  extension  pertains  to  the  case  where  the  filters  p(z)  are 
chosen  to  be  high-pass.  This  might  be  useful  when  the  signal  contains  an 
underslrable  low  frequency  drift  component. 
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APPENDIX  A 


s 


PENCIL  OF  FUNCTIONS 

A  useful  mathematical  entity  arises  by  combining  tvo  given  functions 
defined  on  a  conmon  interval  together  with  a  scalar  parameter 
f(t,Y)  ■  Yg(0  +  Mt). 

We  cell  f  a  pencil  of  functions  g(t)  and  h(t)  parametrized  by  Y-  To  *void 
obvious  triviality,  g(t)  is  not  permitted  to  be  a  scalar  multiple  of  b(t). 

Our  work  requires  consideration  of  sets  of  pencils 

Yg^t)  +  h^t),  Yg2(t)  +  h2(t),  ...,Ygn(t)  +  hn(t)  (2) 

wherein  the  functions*  g^ft) , . . . »gQ(t)  and  h^Ct) ,. . . ,hn(t)  span  separately 
a  common  n-dimensional  subspace  Ln  in  the  function  space.  For  a  fixed  set 
of  values  of  parameters  Y.  the  pencils  obviously  reduce  to  a  set  of  functions, 
and  the  particular  values  chosen  determine  properties  such  as  the  linear 
dependence  or  independence  of  the  set.  The  main  result  concerning  the 
linear  dependence  of  pencil  sets  is  derived  in  [8]  and  can-  be  stated  as 


follows. 

Theorem:  Given  that  the  pencil  set  (2)  is  linearly  dependent,  the 
parameters  Y  must  satisfy  the  polynomial  equation 

Yn/G[gl,g2,...,gn]  +  YD  1  ‘8^^ 


+  ...  +  Y^'^[h.  ,•••58,  ,»«»,h.  1 

~  K1  1  n-1 


+  /(7{h^,h2,...  .h^]  *  0 


In  every  sum  term  here,  the  i’s  and  k’s  form  a  complete  complementary  set 

of  indices  over  the  integers  l,2,...,n;  furthermore,  the  notation 

Glfj,. . .  ,fnl  stands  fpr  the  determinant  of  the  n-dimensional  Gram  matrix  MU 

*A11  functions  are  defined  on  a  common  interval  [a,b],  with  the  usual  inner 
product  denoted  as 

<f,g>  “  j  f(t)g*(t)dt. 
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of  ths  functions  f - » • • • » f  »  i* » 
l  n 

-  iet[gik  -  <f1»fk>l»  i»*  "  1 . »• 

Lastly,  we  remark  that  the  sign  of  each  sum  term  is  to  be  determined  as 
Indicated  in  [8]. 

The  above  discussion  is  equally  valid  for  discrete-time  signals. 

To  this  end  the  functions  f(t),  g^t)  and  h±(t)  must  be  replaced  by  the 
sequences  f(k),  gjCk)  and  h±(k),  and  of  course  the  inner  product  must  be 
redefined  as 

K-l 

<f,g>  -  I  f (k)g*(k) 

k-0 

APPENDIX  B 

NOISE  ESTIMATION  AND  CORRECTION 
We  observed  in  Section  IV  that 

E  G  -  F  +  O2  W  *  (Bl) 

where  G  is  the  Gram  matrix  of  the  noisy  information  signals  x^,..  ,xn+r 

Clearly,  a  good  estimator  of  F  is 

F  -  G  -  O2  w  (32) 

2 

Unfortunately,  this  estimator  is  not  useable  because  o  is  unknown.  We 
must  estimate  it  using  a  property  of  the  true  information  signals  states 
in  Section  III;  The  true  information  signals  y^»****yn+i  are  linearly 
dependent  and  their  Gram  matrix  is  singular.  Thus  we  require 

|f|  -  |G  -  O2  W|  -  0  (B3) 

Assuming  that  0  is  small,  and  retaining  only  the  first  two  terms  of  the 
Taylor  series,  we  have 

|G|  -  O2  Zl(G,W)1|  -  0  (B4) 
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where  the  notation  (G,W)  stands  for  the  matrix  obtained  by  replacing 
the  ith  column  of  C  by  the  ith  column  of  W. 

A  little  manipulation  of  (B4)  now  readily  yields  relation  (16)  of 
Section  XV. 
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APPENDIX  C 


Toble  Cl 

Estlmoted  Poles  for  Fifty  (50)  Runs  of  the  Noisy  Slanol 
of  Example  1 

.  Method  Used:  Pencll-of-Functlons 


r»tc  i 


Mel 

leeg 

0.8248 

0.0 

0.8407 

0.0 

0.8323 

0.0 

0.8530 

0.0 

0.8359 

0.0 

0.8504 

0.0 

0.8501 

0.0 

0.8231 

0.0 

0.8347 

0.0 

0.8422 

0.0 

0.8471 

0.0 

0.8312 

0.0 

0.8301 

0.0 

0.8428 

0.0 

0.8393 

0.0 

0.8414 

0.0 

0.8489 

0.0 

0.8518 

0.0 

0.8279 

0.0 

0.8312 

0.0 

0.8332 

0.0 

0.8561 

0.0 

0.8411 

0.0 

0.8538 

0.0 

0.8437 

0.0 

0.8288 

0.0 

0.8370 

0.0 

0.8490 

0.0 

0.8589 

0.0 

0.8128 

0.0 

0.8368 

0.0 

0.8392 

0.0 

0.8547 

0.0 

0.8448 

0.0 

0.8440 

0.0 

O. 8348 

0.0 

0.8365 

0.0 

0.8431 

0.0 

0.8517 

0.0 

0.8509 

0.0 

0.8497 

0.0 

0.8487 

0.0 

0.7981 

0.0 

0.8203 

0.0 

0.8495 

0.0 

0.8234 

0.0 

0.8485 

0.0 

0.8412 

0.0 

0.8516 

0.0 

0.8521 

0.0 

Pole  2 


Mel 

l*efl* 

0.8780 

0.2962 

0.8741 

0.3091 

0.8627 

0.3081 

0.8750 

0.3196 

0.8849 

0.3116 

0.8691 

0.3192 

0. 8879 

0.3150 

0.8632 

0.3054 

0.8717 

0.2871 

0.8711 

0.3132 

0.8606 

0.3137 

0.8783 

0.3081 

0.8951 

0.2904 

0.8882 

0.3058 

0.8726 

0.3062 

0.8661 

0.3074 

0.8840 

0.3179 

0.8826 

0.3040 

0.8666 

0.3143 

0.8885 

0.2889 

0.8722 

0.3273 

0.8835 

0.3068 

0.8907 

0.3069 

0.8691 

0.3161 

0.8823 

0.3099 

0.8787 

0.2983 

0.8760 

0.3014 

0.8764 

0.3193 

0.8672 

0.3212 

0.8719 

0.2889 

0.8839 

0.3128 

0.8853 

0.3134 

0.8830 

0. 3170 

0. 8982 

0.3153 

0. 8764 

0.3181- 

0.8834 

0.3094 

0.8774 

0.2962 

0.8929 

0.3083 

0.8659 

0.3316 

0. 8686 

0.3219 

0.8852 

0.3030 

0. 8806 

0.3044 

0.8851 

0.2671 

0.8794 

0.3053 

0.8870 

0.3099 

0.8760 

0.3096 

0.8750 

0.3153 

0.8956 

0.2985 

0.8758 

0.3249 

0.8850 

0.3106 

Pole  3 


Mel  loeg . 


0.8780  -0.2962 
0. 8741  -0.3091 
0.8627  -0.3081 
0.8750  -0.3196 
0.8849  -0.3116 
0.8691  -0.3192 
0.8879  -0.3150 
0.8632  -0.3054 
0.8717  -0.2871 
0.8711  -0.3132 
0.8606  -0.3137 
0.8783  -0.3081 
0.8951  -0.2904 
0.8882  -0.3058 
0.8726  -0.3062 
0.8661  -0.3074 
0.8840  -0.3179 
0.8826  -0.3040 
0.8666  -0.3143 
0.8885  -0.2889 
0.8722  -0.3273 
0.8835  -0.3068 
0.8907  -0.3 069 
0.8691  -0.3161 
0.8823  -0.3099 
0.8787  -0.2983 
0.8760- -0.3014 
0.8764  -0.3193 
0.8672  -0.3212 
0.871?  -0.2889 
0.8839  -0.3128 
0.8853  -0.3134 
0.8830  -0.3170 
0.8982  -0.3153 
0.8764  -0.3181 
0.8834  -0.3094 
0.8774  -0.2962 
0.8929  -0.3083 
0.8659  -0.3316 
0.8686  -0.3219 
0.8852  -0.3030 
0.8806  -0.3044 
0.8851  -0.2671 
0.8794  ‘-0.3053 
0.8870  -0.3099 
0.8760  -0.3096 
0.8750  -0.3153 
0.8956  -0.2985 
0.8758  -0.3249 
0.8850  -0.3106 


Iofele  C2 

Estimated  Poles  for  Fifty  (50)  Runs  of  the  Noisy  Signal 
of  Exanole  1 


Method  Used:  Pencll-of-Functlons  with  Noise  Correction 


Role  I  Pole  1  _ foie  3 


Real 

Real 

Inaa. 

Real 

l*N. 

0.8287 

0.0 

’  0.9223 

0.2738 

0.9223 

-0.2738 

0.8485 

0.0 

0.9100 

0.2944 

0.9100 

-0.2944 

0.8421 

0.0 

0.8972 

0.2977 

0.8972 

-0.2977 

0.8613 

0.0 

0.9121 

0.3043 

0.9121 

-0.3043 

0.8405 

0.0 

0.9165 

0.2957 

0.9165 

-0.2957 

0.8582 

0.0 

0.9105 

0.3002 

0.9105 

-0.3002 

0.8554 

0.0 

0.9167 

0.3001 

0.9167 

-0.3001 

0.8331 

0.0 

0.9123 

0.2906 

0.9123 

-0.2906 

0.8423 

0.0 

0.9142 

0.2686 

0.9142 

-0.2686 

0.8502 

0.0 

0.9072 

0.2985 

0.9072 

-0.2985 

0.8550 

0.0 

0.8944 

0.2971 

0.8944 

-0.2971 

0.8390 

0.0 

0.9298 

0.2877 

0.9298 

-0.2877 

0.8362 

0.0 

0.9356 

0.2713 

0.9356 

-0.2713 

0.8485 

0.0 

0.9119 

0.2957 

0.9119 

-0.2957 

0.8459 

0.0 

0. 9091 

0.2890 

0.9091 

-0.2890 

0.8470 

0.0 

0.9004 

0.2882 

0.9004 

-0.2882 

0.8562 

0.0 

0.9216 

0.3014 

0.9216 

-0.3014 

0.8575 

0.0 

0.9162 

0.2855 

0.9162 

-0.2855 

0.8367 

0.0 

0.9067 

0.3014 

0.9067 

-0.3014 

0.8353 

0.0 

0.9273 

0.2681 

0.9273 

-0.2681 

0.8393 

0.0 

0.9042 

0.3152 

0.9042 

-0.3152 

0.8628 

0.0 

0.9180 

0.2888 

0.9180 

-0.2888 

0.8467 

0.0 

0.9258 

0.2895 

0.9258 

-0.2895 

0.8619 

0.0 

0.9042 

0.2999 

0.9042 

-0.2999 

0.8488 

0.0 

0.9078 

0.2965 

0.9078 

-0.2965 

0.8351 

0.0 

0.9145 

0.2827 

0.9145 

-0.2827 

0.8429 

0.0 

0.9161 

0.2816 

0.9161 

-0.2816 

0.8549 

0.0 

0.9092 

0.3025 

0.9092 

-0.3025 

0.8659 

0.0 

0.9076 

0.2997 

0.9076 

-0.2997 

0.8209 

0.0 

0.9134 

0.2748 

0.9134 

-0.2748 

0.8431 

0.0 

0.9234 

0.2953 

0.9234 

-0.2953 

0.8460 

0.0 

0.9299 

0.2934 

0.9299 

-0.2934 

0.8629 

0.0 

0.9230 

0.2995 

0.9230 

-0.2995 

0.8495 

0.0 

0.9236 

0.3024 

0.9236 

-0.3024 

0.8484 

0.0 

0.9097 

0.2995 

0.9097 

-0.2995 

0.8405 

0.0 

0.9146 

0.2953 

0.9146 

-0.2953 

0.8432 

0.0 

0.9124 

0.2804 

O.  9124 

-0.2804 

0.8474 

0.0 

0.9208 

0.2929 

0.9208 

-0.2929 

0.8589 

0.0 

0.8956 

0.3177 

0.8956 

-0.3177 

0.8584 

0.0 

0. 9091 

0.3029 

0.9091 

-0.3029 

0.8550 

0.0 

0.9104 

0.2897 

0.9104 

-0.2897 

0.8542 

0.0 

0.9126 

0.2870 

0.9126 

-0.2870 

0.8046 

0.0 

0.9260 

0.2519 

0.9260 

-0.2519 

0.8272 

0.0 

0.9106 

0.2946 

0.9106. 

-0.2946 

0.8543 

0.0 

0.9198 

0.2906 

0.9198 

-0.2906 

0.8304 

0.0 

0.9115 

0.2966 

0.9115 

-0.2966 

0.8555 

0.0 

0.9126 

0.2975 

0.9124 

-0.2975 

0.8465 

0.0 

0. 9223 

0.2854 

0.9223 

-0.2854 

0.8587 

0.0 

0.9082 

0.3112 

0. 9082 

-0.3112 

0.8590 

0.0 

0. 9232 

0.2917 

0.9232 

-0.2917 

Igple-CS 


Estimated  Poles  for  Fifty  (50)  Runs  of  the  Noisy  Slpnol 
of  Example  1 

Method  Used:  Prony  (or  All-Pole  Covariance) 


Pole 

J _ 

Pole  2 

Pole  3 

•eel 

•■eg. 

•eel 

■■•g- 

•eel 

•■■g- 

0.7884 

0.0 

-0.4171 

0.0 

0.0552 

0.0 

0.8184 

0.0 

-0. 1840 

0.0426 

-0. 1840 

-0.0426 

0.8087 

0.0 

-0. 1797 

0.2130 

-0.1797 

-0.2130 

0.8244 

0.0 

-0. 1486 

0.2706 

-0.1486 

-0.2706 

0.7762 

0.0 

-0.5476 

0.0 

0.2528 

0.0 

0.8182 

0.0 

-0.2194 

0.0 

-0.1087 

0.0 

0.7642 

0.0 

-0.2156 

0.0 

0.1252 

0.0 

0.7967 

0.0 

-0.4744 

0.0 

0.0461 

0.0 

0.7979 

0.0 

-0.1186 

0.4021 

-0.1186 

-0.4021 

0.7982 

0.0 

-0.4296 

0.0 

0.0885 

0.0 

0.7813 

0.0 

-0.4704 

0.0 

0. 1590 

0.0 

0.8070 

0.0 

-0.1618 

0.4163 

-0.1618 

-0.4163 

0.7954 

0.0 

-0.2521 

0.0 

-0.0181 

0.0 

0.7574 

0.0 

-0.5090 

0.0 

0.4022 

0.0 

0.7788 

0.0 

-0.4379 

0.0 

O. 1270 

0.0 

0.7468 

0.0 

-0. 3464 

0.0 

0.1156 

0.0 

0.2613 

0.0 

0.7826 

0.0 

-0.6150 

0.0 

0.3870 

0.0 

0.7759 

0.0 

-0.6023 

0.0 

0.7692 

0.0 

-0.1222 

0.3752 

-0.1222 

-0.3752 

0.3543 

0.0 

-0.6700 

0.0 

0.7706 

0.0 

0.7547 

0.0 

-0.2677 

0.0 

0.0116 

0.0 

0.8529 

0.0 

-0.3008 

0.0 

-0.0255 

0.0 

0.7767 

0.0 

-0.2661 

0.0 

0. 1377 

0.0 

0.7962 

0.0 

-0.3719 

0.0 

0. 1047 

0.0 

0.7540 

0.0 

-0.3987 

0.0 

0.3012 

OlO 

0.7944 

0.0 

-0.2237 

0.0 

-0.0779 

0.0 

0.8068 

0.0 

-O. 3446 

0.0 

-0.0091 

0.0 

0.7731 

0.0 

-0.2018 

0.0 

-0.0566 

0.0 

0.7827 

0.0 

-0. 5571 

0.0 

0.2154 

0.0 

0.2098 

0.0 

0.7761 

0.0 

-0.6244 

0.0 

0.7999 

0.0 

-0.1537 

0.3256 

-O. 1537 

-0.3256 

0.7866 

0.0 

-0.2558 

0.0 

0.0240 

0.0 

0.8365 

0.0 

-0.2889 

0.0 

-0.0384 

0.0 

0.7855 

0.0 

-0.3534 

0.0 

0.2192 

0.0 

0.7676 

0.0 

-0.1320 

0.1508 

-0.1320 

-0.1508 

0.7902 

0.0 

-0.4645 

0.0 

0.1714 

0.0 

0.7805 

0.0 

-0.4361 

o.'o 

0.1347 

0.0 

0.7629 

0.0 

-0.3311 

0.0 

0. 1737 

0.0 

0. 3584 

0.0 

0.7315 

0.0 

-0.5916 

0.0 

0.7651 

0.0 

-0.4343 

0.0 

0. 1240 

0.0 

0.7965 

0.0 

-0.3931 

0.0 

0.2374 

0.0 

0.7991 

0.0 

-O.  3932 

0.0 

0. 1353 

0.0 

0.7835 

0.0 

-0.1486 

0.2030 

-0. I486 

-0.2030 

0.7904 

0.0 

-0.4655 

0.0 

0.1185 

0.0 

0.8144 

0.0 

-0.0909 

0.2120 

-0. 0909 

-0.2120 

0.7876 

0.0 

-0. 0753 

0.3471 

-0.0753 

-0.3471 

0.7819 

0.0 

-0. 1089 

0.0279 

-0.1089 

-0.0279 

0.6052 

0.0 

-0.3982 

0.0 

0.1758 

0.0 

0.7904 

0.0 

-0.1299 

0.2539 

-0.1299 

-0. 2539 

0.8098 

0.0 

-0. 1021 

0.3111 

-0. 1021 

-0.3111 
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